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This study was conducted in order to determine the differences in integrated scientific 
process skills (designing experiments, forming data tables, drawing graphs, graph 
interpretation, determining the variables and hypothesizing, changing and controlling 
variables) of students (n — 17) who were taught with an approach based on scientific 
argumentation and of students (n — 17) who were taught with a traditional teaching 
approach in Grade 11 chemistry. The study was conducted at a high school in Qankiri, 
Turkey. A multiformat Scientific Process Skills Scale was administered to both groups as a 
pre- and posttest; it contained 29 items in 5 modules and consisted of limited and 
unlimited open-ended, multiple-choice, and paper-pencil performance assessment 
questions. Repeated /-test and analysis of variance (MANCOVA) were applied to analyze 
the data. It was found that the integrated scientific process skills of students in both 
groups improved significantly except skills of “forming a data table” and “graphic 
interpretation skills” for group. MANCOVA results revealed that there was a statistically 
significant difference between the groups on the combination of 5 dependent variables. 
The teaching approach had a significant effect on integrated scientific process skills except 
for the designing experiments skills. In sum, the scientific argumentation-based teaching 
approach was more effective in acquiring science process skills than the traditional 
teaching approach. 

Keywords : Scientific argumentation, scientific process skills, chemistry education, secondary 
education. 


INTRODUCTION 

With rapidly and daily increasing scientific knowledge accumulation, scientific literacy is becoming more 
important for every individual. The purpose of scientific literacy is not to make all individuals experts on science and 
technology; rather, its purpose is to make people who have studied compulsory basic science individuals who can 
keep pace with the world they live in, understand the facts and events they face, think rationally, and have 
confidence in themselves in today’s information age (Laugksch & Spargo, 1996). 

When students gain the habits of mind that comprise experience and scientific literacy through inquiries, 
problem solving and critical thinking, they also learn how to apply basic scientific concepts to everyday situations 
(Lee & Fradd, 1996). In high school and university when advanced science is studied, few individuals can learn the 
scientific method (of thinking) because science is taught as a discipline based on facts rather than through a 
discovery method of learning. In today’s information age, the basic aims of science education in terms of both 
students’ specific content and specific process are: make them acquire the attainment methods using skills of 
knowledge; develop understanding on social and scientific issues; and have control over scientific facts, conceptions, 
and principles rather than transferring present knowledge to them (Schafersman, 1991; Van Driel, Beijard, & 
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Verloop, 2001; Zachos, Hick, Doane, & Sargent, 2000). This can only come about through higher cognitive process 
skills containing scientific process skills, scientific method, scientific thinking, and critical thinking forms. The 
scientific method, scientific thinking, and critical thinking have been terms used at various times to describe these 
scientific skills. Today the term scientific process skills is commonly used (Padilla,1990). 

Scientific process skills, the basis of scientific literacy, are basic skills that make learning science easier, encourage 
student participation, improve the feeling of responsibility in learning, increase permanence in learning, make 
understanding the acquisition of knowledge that they apply in everyday life problems easier, and prepare students 
for their future lives (Schafersman, 1991). That these skills are effective in science learning is emphasized in 
numerous studies (e.g., Chang & Weng, 2000; Flores, 2000; Harlen, 1999; Ostlund, 1998; Turpin & Cage, 2004). 

When classification for scientific process skills are examined, it can be seen that these skills are handled in two 
stages, namely, basic and integrated (Rezba et al., 1995). Basic process skills are: observation, inference and 
classification, measurement, estimation, using numbers, interaction and using time-space relations. Integrated 
scientific process skills are well rounded, based upon basic process, and require a higher cognitive level. Normally, 
each process is made up of the combination of two or more basic processes. During this process, also called 
experimental process, variables are determined, a hypothesis is built up, data are accessed to back up or rebut that 
hypothesis, data are recorded, and finally a decision is reached. During this process, students seek to answer the 
question How can I discover? (Harlen, 1999; Rezba et al., 1995). 

Numerous research projects (Ergiil et al., 2011; Karamustafaoglu, 2011; Kocakiilah & Sava§, 2013; Serin, 2009) 
focused on the teaching and acquisition of basic and integrated science process skills found that students’ scientific 
process skills improve as they use them. Teachers cannot expect mastery of experimenting skills after only a few 
practice sessions. If science educators give students multiple opportunities to use their process skills, encourage 
them for critical opinions in different content areas and contexts, then they will support meaningful learning 
(Padilla, 1990). To achieve this, an activity based on scientific skills, which determine the basic elements of scientific 
methodology, will guarantee the improvement of knowledge that is based on both scientific concepts and factual 
concepts (Ebenezer & Haggerty, 1999). 

Learning science is not only students obtaining knowledge about their environment but also grasping the 
scientific way of learning, suggesting claims about a problem, persuading the other party, and being able to argue as 
to defend the claims they have joined through scientific research to make them clear (Skoumios, 2009). Hence, 
science generally improves not through agreements but through objections, conflicts, and arguments. Also, since 
understanding the relation between a claim and evidence is understanding a claim and the truth, it helps develop 
scientific skills (Erduran, Simon, & Osborne, 2004). It seems reasonable to conclude that students learn the basic 
skills better if they are considered an important object of instruction and if proven teaching methods are used 
(Ebenezer & Haggerty, 1999). Learners could acquire scientific process skills by teachers creating constructivist 
learning environments and employing instructional strategies in science education (Onal, 2005, 2008; Scherz, Bialer, 
& Eylon, 2005). In scientific process, it is necessary to determine more than one point of view and idea, develop 
proper solutions, and back these solutions up with data and evidence. If we want students to understand scientific 
process and applications, we should add arguments, conflicts, and heuristic rules based on scientists’ interpretations 
to the results of experimental details rather than only pronouncing them (Nussbaum & Sinatra, 2003). At this point, 
scientific argumentation has emerged as an important technique (e.g., Arcidiacono & Kohler, 2010; Bricker & Bell, 
2008; Cross, Taasoobshirazi, Hendrick, & Hickey, 2008; Erduran, Arda$, & Yakmaci-Guzel, 2006; von 
Aufschnaiter, Erduran, Osborne, & Simon, 2008). Additionally, since scientific argumentation is a process of using 
evidence and defending a point of view, it is related to scientific process skills. 

Numerous studies have been conducted based on the belief that “learning through arguments is learning how to 
think”; processes such as obtaining scientific knowledge, explaining, modelling, and hypothesizing (Driver, Newton, 
& Osborne, 2000), assessing alternatives and evidence, interpreting texts and assessing the viability of scientific 
claims, and developing mental activities are considered as basic components in conducting scientific arguments. 
Therefore, argumentation is an essential component in doing science and communication through scientific claims 
(Cross et al., 2008; Erduran et al., 2004, 2006; Sampson & Clark, 2011). 

Argumentation has cognitive values in science education; for example, when considering cognitive perspective, 
argumentation contains the reasoning of individuals and in classes where arguments take place and students express 
their thoughts. Expressing thoughts in this way helps students change direction from their inner psychological area 
(mind) and rhetorical arguments to their outer psychological area (classroom) and dialogic arguments. In science 
education, practicing the teaching approach that provides a student-centered learning environment ensures students’ 
cognitive skills as well as skills of reasoning and examination; and it supports scientific process skills, reasoning and 
questioning skills, and improves scientific epistemology (Lemke, 1990; von Aufschnaiter et al., 2008), science 
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literacy, conceptual understanding, and research skills (Simon, Erduran, & Osborne, 2006; von Aufschnaiter et al., 
2008). 

Recendy, science education has paid attention to studies about the importance of argumentation in practice, the 
evaluation of scientific education, and obtaining scientific knowledge (Driver et al., 2000; Erduran et al., 2004; 
Sampson & Gleim, 2009). Moreover, it is observed that most of the research conducted is about how students learn 
scientific concepts and how they can learn them better (Aydeniz, Pabuccu, Cretin, & Kaya, 2012; Kaya, 2013; Kaya, 
Erduran, & Cretin, 2012); it is not about the effectiveness of the scientific argumentation method — in which teaching 
methods such as problem solving, critical thinking and scientific thinking skills are used — about required skills, 
knowledge, and attitude development needed for students to become scientific literates directly on science (or 
chemistry) subjects. 

In order to improve their scientific understanding, students need to use arguments in structured activities and 
practice about this. Activities that will help students overcome the gap between knowing what is true technically and 
having the adequate understanding and ability to say the right things in the right time and right place are needed 
(Osborne, 2002). These activities can be applied easily to the learning environment in which an argumentation-based 
teaching approach is used. In argumentation-based learning media, there are activities that help students learn 
science using claims; for example, expression table, estimation-observation-explanation, designing experiments, 
forming arguments, theories in race with caricatures, theories in race with opinions and evidence, concept maps 
(Osborne, Erduran, & Simon, 2004a). In this study, in the treatment group in which a scientific argumentation- 
based teaching method was applied, all these activities were exercised other than concept maps. The effects of 
integrated scientific skills of the instructional approach on skills such as determining variables of an experiment, 
changing variables, designing an experiment, drawing and interpreting graphs, drawing tables, hypothesizing directed 
toward the solution of a problem, and determining dependent, independent, and controlled variables according to 
the hypothesis were investigated. The following research questions were investigated: 

• Is there a significant difference between pretest and posttest scores of the control and treatment groups? 

• Is there a significant difference between control and treatment group students in terms of integrated 

scientific process skills? 

METHOD 

The purpose of the study was to explore the impact of argumentation-based classroom activities on high school 
students’ integrated scientific process skills compared with the scientific process skills of students taught through a 
traditional teaching approach. Targets aimed at scientific process skills that the students were intended to gain were 
designed under headings like before running experiment, experimental stage, and after experiment in a way in which 
the acquisitions of the Grade 11 Chemistry Teaching Program (2008) were included (see Giiltepe, 2010). Practices 
applied in the treatment and control groups included the Reaction Rate, Chemical Equilibrium, Solubility 
Equilibrium, and Acids and Bases Equilibrium units of the Grade 11 curriculum. Since the acquisition of scientific 
process skills would take time, the research lasted for the two terms of the educational year. 

Design 

The study was conducted in an urban public science high school that was selected because of its suitability in 
(Rankin, Turkey, during 2008-09. There were four Grade 11 classes in the school. Students who participated in the 
study had been selected by a central examination who were accomplished at Maths and Science. Students were 
assigned to their classes by school management homogeneously according to their exam results. Since threir exam 
points were more or less the same, the success rates of the classes were similar. Two of the four classes were chosen 
at random for this research by the school principal and one was assigned as the control group; the other served as 
the treatment group. The chemistry lessons were conducted with treatment group through a teaching approach 
based on scientific argumentation while the control group was taught by a traditional teaching approach. There were 
17 students (7 girls, 10 boys) in the treatment group and 17 students (8 girls, 9 boys) in the control group. The ages 
of participants ranged between 16 and 17 years. All students were taught by the same chemistry teacher.The study 
was conducted over a 29-week period on the following topics: reaction rate for 7 weeks, chemical equilibrium for 10 
weeks, solubility product for 5 weeks, and acids and bases for 7 weeks. To understand equilibrium in aqeous 
solutions (acids and bases, solubility equilibrium) better, dynamic equilibrium in reactions should be understood 
better .Dynamic equilibrium is related with the reaction rate which is based on collision theory( Kaya, 2013; Pekmez 
2010). Therefore these concepts follow and build onto each other. These subjects which are a continuation of each 
other are abstract so they are difficult to understand for student and they mainly require the usage of scientific 
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process skills. In the earlier studies conducted about these subjects researchers investigated students’ 
misconceptions and the effect of instructional approach on students’ conceptual understanding (Atasoy, Akku^, & 
Kadayiftp, 2009; Co^tu & Unal, 2004; f)akmak(p & Leach, 2005; (Jelik & K 1 I 19 , 2014; Demircioglu & Yadigaroglu, 
2011; Giiltepe & K 1 I 19 , 2013; Kaya, 2013; Ozmen et al., 2012). In some of them it was stated that students had 
difficulty in stages of understanding graphs and designing an experiment (Co^tu & Unal, 2004; Demircioglu & 
Yadigaroglu, 2011; Kaya, 2013; Ozmen et al, 2012). On the other hand the acquisition of scientific process skills 
reqiures a long time (K 1 I 19 , Yildinm, & Metin, 2010). Therefore, we conducted our research through these subjects 
which compose grade 11 chemistry curriculum. 

At the high school where the study was conducted, students studied Chemistry 4 hours weekly. Chemistry classes 
of control and treatment groups were taught in accordance with Grade 11 Chemistry Teaching Program (2008) 
which involved basic acquisitions such as learning and associating new concepts, improving scientific process skills 
in the envisaged time. Classes in two groups were operated with the same examples and experiments. 

In the control group, the teacher (researcher) lectured by a classic course plan that she had prepared according to 
the way chemistry courses were conducted in the high school the study was carried out. Course books, 
supplementary materials, and computer animations were used as course materials. The lessons usually started with 
the teacher’s questions and the students’ answers and then moved on with her narration. Sometimes, however, 
classes turned into unconfigured classroom discussions in which qualifiers, backings, and rebuttals were used. When 
this happened, the teacher allowed the lesson to continue that way without any interference. After the necessary 
concepts about the subject had been explained, exercises were done and problems were solved about it. 

For example, at the beginning of the lesson about buffer solution; first of all, the control group students were 
asked about what would have happened if strong acid or base had been added into a hydrogen cyanide solution and 
were also asked to interpret the incident in terms of particular size. A conclusion was drawn evaluating the given 
answers. Questions about the subject were solved and the participation of students was paid special attention to. 

In the treatment group, students were formed into small groups of three to four that considered chemistry 
concepts and the suggestions of their teacher, during the instruction. Students were homogenously picked for these 
groups based on their success and participation rate in chemistry class. Students in the groups were changed from 
time to time. During the four hours of weekly class time, instruction was conducted through discussion activities in 
a classroom order that students formed. For the discussion activities, students were asked to constitute their claims 
by making use of data individually, then small-group discussions were held, and finally a classroom discussion was 
held. While students configured their knowledge / concepts in the scientific approach process, all discussion 
activities were conducted with a claim based on data and a reason explaining the relationship between (a) a claim, a 
warrant, and rebuttals; (b) data, a claim, a warrant, and back-ups; and (c) data, a claim, a warrant, and rebuttals in 
accordance with Toulmin’s (1958) discussion model. Discussions sometimes began with students’ questions during 
lecturing and sometimes through making use of the teacher’s questions; to begin a discussion, activities introduced 
in the IDEAS (Osborne, Erduran, & Simon, 2004b) packet were usually used. 

In treatment group for the reaction rate unit, 13 activities were used; for the chemical equilibrium unit, 8 were 
used; for the solubility equilibrium unit, 5 were used; and for the acids and bases unit, 10 were used. Examples of 
activities used in some of the arguments are given in Table 1. 

When a certain problem was given to students (see Activity 1 in Table 1), they were asked to follow the path that 
scientists did or they were given ready data (e.g., graph, table, numerical values) of a conducted experiment and 
asked to interpret these data by building reason-result relations, obtaining results from them, and discussing the 
accuracy or inaccuracy of these results (see Activity 2 in Table 1). 

Activity papers were handed out to each student and they were asked to discuss them in their own minds first. 
Then individual activity papers were taken back and the students were asked to study in groups of three or four. 

As mentioned above about the “Buffer Solution” example, lessons with control group were mostly conducted 
with questions in the first place, then it moved on with teacher lecture and questions which were asked occasionally. 
With treatment group, as in other subjects, buffer solution was studied through activity ( see Activity 3 in Table 1). 
How class discussion was conducted by Toulmin discussion model in “Buffer Solution” activity which had been 
designed to be applied in “Acids and Bases” unit was detailed step by step in Appendix 1. As in other activities, in 
“Buffer Solution” activity, after presenting information about it, students were asked to specify their claims 
(hypotheses) about a problem situation. 

In this step — which is the first one in scientific discussion — students are expected to structure their newly-gained 
knowledge through associating their prior knowledge or an incident given via data (graph, table) or story and to 
verify or rebut their claims. In all discussion activities, students thought as scientists and structured their 
knowledge/conceptions in scientific method process, moreover, the model which Toulmin built over functional 
relations between elements of discussion was applied. 
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Table 1 

Activity Examples Used in the Treatment Group 

Activity 1. Selective Precipitation 

Suggest an appropriate method to separate S O4 2 ' and Br amons sepaxatehr in a solution containing 
NaiSGu and NaBr salts in equal mole numbers. Write the steps of the method you are going to apply. 
What should be paid attention to in order to apply this method success fuDv? 

'-*** You can use the solubility product constant (Ksp) table of salts while determining the method. 


Activity 2: Reaction Mechanism 

The reaction of X substance decomposing and turning into Q substance reaction is as below: 

X -► Q AH > 0 

Some scientists experimented to find the mechanism of this reaction. They measured the 

con centration o f the sub stances within, the reaction until the reaction came to an en d and drew a 

graph with the findings. How many stages are there in the reaction of this graph? Define J. 

J is an intermediate. J is a catalyst. J is an activated complex. 

Molality fM) 

P] 


*, Time (mini 



Activitv 3: Butter Solutions 


jEWi^r solution is an aqueous solution consisting of a mixture of a weak acid and its conjugate bare or a weak &ase and 
its conjugate add 

What will happen when acid (Figure 2) and base (Figure 3) solution is added to the the container tha 
contains hvdrohgen cyanide in figure 1. Draw the result aspect 

Explain the events occur at a particular leveL In which container will a buffer solution 

form? : Cyanide ion P Hvdrogen atom I^^Gxvgen atom dAb : Hvdromum ion 


Figure L 


Figure 2 



Adding 2 H~ 


B ■ tN iyofilanm gflsEerlr. 

O : Hidrajcn aEumlim. 

B : Oksijcd -uiomlan 


Adding 3 OH- 



Figure 3 


Group argumentations conducted in Activity 1 and Activity 2 were given as an example in Appendix 2. 
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Scientific process skills scale (SPSS) 

In order to determine if the students had the necessary prior knowledge and skills needed for laboratory studies, 
the Scientific Process Skills Scale (SPSS), which aims to measure SPS such as determining variables, hypothesizing, 
designing experiments, recording data, drawing graphs, reading graphs was given. SPSS was selected because the 
effect of teaching method on each of the students’ scientific process skills separately in detail disregarding 
conceptual understanding was being examined. The SPSS in this study contained questions from both the researcher 
and Temiz (2007), who had built a multiformat test of 171 items in five modules. The SPSS has a multiformat 
structure composed of five modules of 29 items that measure the improvement of determined skills (Table 2). It 
contains open-ended, multiple-choice, paper-pencil performance evaluation questions. The scale was applied to both 
the control and treatment group students as pre- and posttests. It was administered in a 90-minute period both prior 
to and following the instruction. The evaluation of five basic skills under the five modules in the scale is explained 
next (see Appendix 3 for the scoring rubrics). 

Module 1 — Skills of designing experiments. In the first part of the scale, students were asked to design an 
experiment to test a given hypothesis and explain that designed experiment by writing or drawing; in the second 
part, they were asked to choose and mark the most appropriate experiment that tested the given hypothesis. The 
Analytical Criteria Scale of Experiment Design Evaluation (Temiz, 2007) was used to evaluate the experiments 
designed in the first part. Criteria in the scale were gathered in four categories: independent variable, dependent 
variable, controlled variables, and test of hypothesis. In the second part of the scale, each response was scored as 
either correct or incorrect, for a total possible score of 17 points in this module. 

Module 2 — Skills of forming a data table. Findings of several experiments done beforehand were provided to 
students in the form of texts or drawings. They were asked to draw a data table using the data given. To evaluate 
their data tables, the Two- Variable Data Table Analytical Criteria Evaluation Scale” and the “More than Two 
Multivariate Data Analysis Evaluation Criteria Statement” (Temiz, 2007) were used for each question, respectively. 
Criteria in the scale were gathered in six categories: table title, table frame, variable names, units, data record, and 
arrangement. It was possible to receive a total of 47 points for this module. 

Module 3 — Skills of drawing graph. Students were asked to draw graphs using the three tables provided. The 
first two data tables included continuous data groups; the third one included discontinuous data groups. Line 
diagram was expected for continuous data whereas a bar diagram was expected for discontinuous data. The first two 
questions in the module were prepared by the researcher. In order to evaluate their graphs, “Line Graphs Control 
Evaluation List” or “Bar Graphs Control Evaluation List” (Temiz, 2007) were used. In the scale, criteria were 
gathered in four categories: titles, axes, graphs, and neatness and order. It was possible to receive a total of 64 points 
in this module. 

Module 4 — Skills of graph interpretation. Students were asked to make estimations, find maximum, 
minimum points and data couples, find increase-decrease tendency, make conclusions, find relations between 
variables, reach mathematical correlation, compare variables, and associate diagrams with the hypothesis. There were 
a total of 15 multiple-choice questions. Responses were scored as either correct or incorrect, with a total possible 
score of 15 points in this module. 

Module 5 — Skills of determining the variables and building up hypothesis, changing and controlling 
variables. Students were asked to make hypotheses about a given problem situation and record dependent, 
independent, and controlled variables according to the hypothesis that they wrote. For this reason, higher-level 
abilities were needed to determine the variables and hypothesizing. To evaluate student answers, the “Analytical 
Criteria Scale of Determining Variables and Hypothesizing” (Temiz, 2007) was used. Criteria were gathered in three 
categories as determining all variables related with experiment, writing hypothesis, and defining variables. It was 
possible to receive a total of 27 points in this module. The responses of the control and treatment group (n = 34) 
students were evaluated by two coders independently using criteria scales and control lists. Examples of student 
answers in scale are given below in the qualitative results section. 

The independent variable for this research is the teaching approach (scientific argumentation-centered vs. 
traditional), and the dependent variables are the students’ integrated scientific process subskills. 

Validity and Reliability Analyses 

In order to ensure the content validity of the test, three chemistry teachers and three academicians were 
consulted for their opinion on the following characteristics: appropriateness of questions in testing skills, number of 
questions and the duration for answering the questions, clarity of the language of the test, and any errors in the 
speculated situations of questions. The SPSS reliability analyses studies were conducted through test-retest reliability 
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Table 2 

Organization of Test 

Module 

Skill measured 

Question format 

No. of items 

Scoring of each 
item 

1 

Designing experiments 

Open-ended, unlimited 

2 

7 



Multiple-choice 

3 

1 

2 

Forming a data table 

Paper-pencil performance 

2 (<2- 

16 



evaluation 

multivariate) 





1 (2-variable) 

15 

3 

Drawing graph 

Paper-pencil performance 

2 line graphs 

22 



evaluation 






1 bar graph 

20 

4 

Graph interpretation 

Multiple-choice 

15 

15 

5 

Determining the variables and 

Open-ended, limited 

3 

3 


building up hypothesis, changing 





and controlling variables 





analysis containing modules with multiple-choice questions and coherence analyses between coders for modules 
with open-ended questions. 

Test-retest reliability. The test-retest reliability of the total points of open-ended questions during two different 
practice periods of SPSS was evaluated via Pearson correlation analysis in two Grade 11 classes in the same school 
but not part of the and treatment groups. The Pearson correlation coefficient is appropriate for representing 
reliability, indicating the degree of common variance between measures for quantitative and continuous data 
(Rothstein & Echternach, 1993). The last three items of Module 1 (designing an experiment) and Module 4 
(implementing graph) in which the multiple choice questions were included were administered for the second time 
to 34 students 6 months after the first administration. Analyses of the two sets of results indicated Pearson’s 
coefficients as follows: r(33) = .62, p =.000 for Module 1 and f 33) = .60, p — .000 for Module 4. Test-retest 
reliability was moderate for Modules 1 and 4 (0.50—0.74); the test-retest correlations of the scale were considered as 
a supportive finding about the reliability of the coherence of the points (Rothon et al., 2011). 

Intercoder reliability. The reliability of control lists and criteria scales designed to evaluate the modules 
(Modules 1, 2, 3, & 5) containing open-ended questions was tested via intercoder reliability tests. If the rating scale is 
continuous (e.g., 0—10), Pearson’s product moment correlation coefficient is suitable (American Educational 
Research Association, American Psychological Association, & National Council on Measurement in Education, 
1985). The tests showed the level of agreement between two independent coders. In the modules with open-ended 
questions, students were asked to perform a specific task on paper. To test intercoder reliability, a question-by¬ 
question analysis was conducted and Pearson’s coefficients were computed in each subcategory item. To test 
intercoder reliability, the primary researcher and the second coder, a chemistry teacher, coded every transaction. The 
results of the analyses showed that the reliability of coherence means between coders was high and that the grading 
means designed for Modules 1, 2, 3, and 5 were understood the same way with high correspondence rates by 
different coders (Table 3). When the findings are evaluated in a general manner, it can be said that, in terms of the 
sample the study was carried out, the reliability of the SPSS was at acceptable levels. 

DATA ANALYSES 

This study used SPSS 18.0 for statistical analyses. In order to investigate the research questions, repeated t -test 
and multivariate analysis of covariance (MANCOVA) were used. The alpha was set at the typical .05 level. Before 
running analyses, homogeneity of variances assumption had been checked through Levene’s test and there were no 
violations for each dependent variable. As well, homogeneity of covariance assumptions was checked and the 
assumption was met. In this study, students’ answers and drawings were evaluated qualitatively. 

RESULTS 

Quantitative Analysis 

Means and standard deviations for each integrated sub skills are shown in Table 4. The findings show that 
students in the scientific argumentation-based teaching approach had higher scores than students in the traditional 


© 2015 iSER, InternationalJ . Sci. Env. Ed., 10(1), 111-132 


117 





N.Gultepe & Z.Kilic 


Table 3 

Intercodex Reliability for Analytical Criteria Evaluation Scale and Control,List 


In ter coder Pearsons correlation coefficients., r(33) 


Item 

Module 1 - 
Designing an. 
experiment 

Module 2 - 
Forming a data 
table 

Module 3 - 
Drawing a graph 

Module 5 - Determining variables and building 
up hypothesis, changing and controlling 
variables 

i 

.55 

.90 

.73 

.76 

2 

.89 

.90 

.89 

.91 

3 


.89 

.98 

.95 


Table 4 

Descriptive Statistics of Posttest for Both Groups 

skin 

Group 

M 

SD 

N 

Designing experiments 

Control 

13.76 

1.60 

17 


Treatment 

14.76 

1.95 

17 

Forming data tables 

Control 

36.41 

4.91 

17 


Treatment 

40.82 

2.40 

17 

Graph drawing graph 

Control 

41.06 

4.16 

17 


Treatment 

48.94 

7.95 

17 

Graph interpretation 

Control 

13.11 

1.36 

17 


Treatment 

14.12 

1.32 

17 

Determining variables and building 

Control 

21.71 

2.59 

17 

hypotheses; changing and controlling 

Treatment 

24.47 

1.70 

17 

variables 






teaching approach in terms of scientific process skills (designing experiments, forming data tables, drawing graphics, 
graph interpretation, determining the variables and building up hypothesis, changing and controlling variables). 


Repeated t-test 

Repeated /-test was used to determine the change in students’ scientific process skills over time. For the group, 
the results revealed a statistically significant increase in these students’ skill in designing experiments, /(16) = -4.79 ,p 
< .001; drawing graphs, /(16) = -4.58, p < .001; determining variables and building up hypothesis, changing and 
controlling variables, /(16) = -6.23, p < .001. However, there were no statistically significant differences in the 
students’ graph interpretation skills (p = .09) and forming data tables (p = .05) throughout the semester. For the 
treatment group, we found a statistically significant increase in students’ skills in designing experiments, /(16) = - 
8.50, p < .001; forming data tables, /(16) = -5.24, p < .001; drawing graphs, t( 16) = -6.52, p < .001; graph 
interpretation, /(16) = -2.59, p — .002; determining the variables and building up hypothesis, and changing and 
controlling variables, /(16) = -15.47,^ < .001. 

Multivariate Analysis of Covariances (MANCOVA) 

In order to determine if the teaching approach had any effect on students’ improvement in scientific process 
skills, MANCOVA analysis was applied, taking the tests under control. Since five continuous dependent variables 
were used in the study, one-way MANCOVA was used to determine whether there were significant differences 
between the treatment and control groups in terms of the following continuous dependent variables: skill in 
designing experiments (DV1), skill in forming data tables (DV2), skill in drawing graphs (DV3), skill in graphic 
interpretation (DV4), and skill in determining the variables and building up hypothesis, changing and controlling 
variables (DV5). The independent variable was teaching approach. The multivariate analysis of covariance showed 
that there was a statistically significant difference between the treatment and control groups on the combination of 
five dependent variables, Wilk’s lambda = .43 F( 5, 23) = 6.18 p - .001, rj p 2 =.57, indicating that the treatment 
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explained 57% of the variance in dependent variables. The findings suggest that a scientific argumentation-based 
teaching approach is more effective than a traditional teaching approach in acquiring integrated science process 
skills (see Table 5). 

In order to examine the effect of treatment on each dependent variable controlling for the pretest scores, 
ANCOVA was conducted. The results revealed that the treatment (argumentation) had significant effect on the skill 
of forming data tables, F( 1. 27) = 9.99,p - .004, rj p 2 - .27; graph drawing skills, F( 1. 27) = 14.03 ,p = .001, rj p 2 - .34; 
graph interpretation skills, F(l. 27) = 4.45, p — .04, rj p 2 — .14; and skill of determining the variables and building up 
hypothesis, changing and controlling variables, F(l. 27) = 13.45, p — .001, rj p 2 — .33. There was no statistically 
significant difference for skill of designing experiments (see Table 5 for multivariate and univariate analyses of 
variances). 

QUALITATIVE ANALYSIS 

Students’ scientific process skills can be improved in time through activities although some (e.g., designing 
experiment subprocess skills) require more time and effort. The analyses of experiments that students designed in 
the SPSS show that after instruction the designing experiment subskill improved more in the treatment group. A 
question intending to evaluate their experiment designing skills and examples of their responses are given below. 

Question: Design an experiment to test this hypothesis: “The solubility of a solid in water changes according to 
temperature.” 

Student GA (treatmentgroup): First I chose the salt, which dissolved as an endothermic. I put 100 mL of water into 
a tube. I measured the temperature of the water. Then I added well-dissolving salt into this tube. I looked at the 
solubility of this salt at this temperature. I weighed it and added it to the water. Then I put it an ice bath and 
observed the precipitation. Then I weighed the mass of precipitate. 

Student FA (controlgroup): Put the same amount of water into three identical containers under constant pressure. 
Heat the water in the first container to 25°C, the second one to 50°C, the third one to 80°C. Add the same amount 
of sugar into the containers. Then wait and keep on adding into the three containers the same amount of sugar to 
observe the dissolving process. 

Both students chose the dependent variable (solubility of salt), independent variable (temperature), and 
controlled variable (volume of water, salt); however, FA chose pressure as a controlled variable incorrectly. Also, FA 
suggested adding the same amount of salt in different temperatures of water. If this was done, the amount of grams 
of salt dissolved could not be measured. 

The analyses of student responses showed that students in both groups mentioned how the independent variable 
could be changed. Controlled variables were mentioned by students in both groups; however, control group 
students used controlled variables more accurately. For example, in the question that examines the effect of 
temperature on the solubility of salt, 4 students in the control group determined the type of container and pressure 
as the constant variable; 4 students in the control group and 9 students in the treatment group stated how the 
dependent variable could be measured (determined). 

In Module 3, students were asked to build a data table. When data in the table were examined, it was observed 
that no student in either group named the table in pretests and posttests. Examples of students’ tables drawn in the 
posttest are shown in Figure 1. It was also noted that students in the treatment group like HK, ES and F§ (n— 13) 
and in control group like FA and SE drew the tables in the posttest more orderly and paid attention to the sequence 
of data (n — 9); however, students both groups paid less attention to the sequence of data like EK and AY (n — 4) 


Table 5 

Multivariate and Univariate Analyses of Variances 






ANCOVA 




MANCOVA 

DV1 

DV2 

DV3 

DV4 

DV5 

Variable 

F( 5,23) 

F( 1,27) 

F( 1,27) 

F( 1,27) 

F( 1,27) 

F( 1,27) 

Group 

6.18* 

3.12 

9.99* 

14.03* 

4.45* 

13.45* 


Note. F-ratios are Wilk’s approximation; MANCOVA = multivariate analysis of covariance; ANCOVA = analysis 
of covariance; DV = dependent variable. 

< *05. 
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in the reatment group and YO, AS and Cl (n — 8 ) in control group, and 14 students in the treatment group and 11 in 
the control group completed the units. 

In Module 4, students were asked to draw a graph. Sample questions and students’ drawings about these 
questions are given in Figure 2. When the graphics were examined, some important results were seen. First, no 
student in either group named the table in both the pretest and posttest. Second, 11 students in the treatment group 
and 7 students in the control group wrote the names of variables next to x-axis and y-axis and units. For instance, 
AS and HD (control group) and AY and EK (treatment group) and did not write the names of the variable next to 
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Question: Inci realized that the water she left in a container under the sun heated up after a while. She decided to 
find out the reasons why that happened. 


Group 


Control 


Treatment 


Hypothesis 


Dependent variable 

Independent 

variable: 


Control variable 


HD: The more the amount of water, the less 
it heats up. 

SE: The more you keep the containerfilled 
with water under sunlight, the more water 
heats up. 

HD: Temperature of water 

SE: Temperature of water 

HD: Amount of water 

SE: Duration of exposition to the sun 

HD: Temperature, type of the container 

SE: Duration of sunlight, amount of water, 
type of the container 


F§: If you expose water in a container a lot, it heats 
up accordingly at the same duration. 

ME: If you put the same amount of water in two 
identical containers and leave one of them under shade 
and the other one under sunlight, the one under the sun 
heats up in a short time. 

F§: Temperature of water 

ME: Temperature of water 

F§: Duration that water stays under the sun 

ME: Duration of exposition to the sun 

FfrType and colour of the container, amount of water, 

siye of the container, intensity of sunlight 

ME: Volume and colour of the container, purity and 

amount of water 


the axis (Figure 2a, 2b & 2c); and FA and HD (control group) and HK and AY (treatment group) did not write units 
(Figure 2a, 2b & 2c). In addition, 15 students in the treatment and 12 students in the control groups numbered axes 
in an ascending order in equal intervals. Third, 13 students in the treatment and 9in the control groups drew an 
appropriate graph format for data and placed all data pairs on the axes correctly. To illustrate, although HD (control 
group) and EK (treatment group) could not draw a bar graph correctly, ES (treatment group) drew a pie graph as a 
different form (Figure 2b). Fourth, three students in the control group and a student in the treatment group drew 
their graphs outside the specified space (Figures 2a, 2b, & 2c). Finally, treatment group students had higher ability 
compared to the control group in drawing suitable graphs (linear or curve) for data and dividing the area width of 
axis in the order of increase-decrease equally suitable to the covered area in the graph paper. These students 
reflected some details such as whether the lines in the graph were straight or curved and, for the curved graph, the 
direction of the linearity, for example, Gf, ZO, and HK in the treatment group and SE and MES in the control 
group (Figure 2a & 2c). This was an indicator that they configured concepts accurately and deeply. However, 
students like AU, FA, and HD (control group) and EK (treatment group) couldn’t notice this detail (Figure 2a & 
2 c). 

When the data in Module 5 were examined, it was seen that treatment group students had higher abilities 
compared to control group in determining control variables, measuring the change in the dependent variable 
depending on the independent variable, detecting the relationship between dependent and independent variables 
and designing a sufficient experiment to test a given hypothesis, and determining the variables of the situation of a 
given problem and the variables toward its solution. Some examples of hypotheses and variables that the students 
determined follow. 

For example; the students in treatment group identified a great number of control variables. In accordance with 
the hypothesis of SE, the amount of water should be identified only as an independent variable; but she also wrote it 
in control variable part. Also, ME in the treatment group wrote control variables (type of container and amount of 
water) in hypothesis sentence. 

According to these results, it can definitely be concluded that the students’ writing their claims on the activity 
papers with reasons in the argumentation activities contributed to their expressing the experiments and hypotheses 
they designed in both a written and oral format. 

GENERAL DISCUSSION 

Experience that individuals acquire through their lives is very important in terms of education. This experience 
causes one or two changes in topics such as getting information about facts, skill improvement, and conceptual 
understanding. In this study, both a traditional teaching approach and an argumentation-based teaching approach 
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made contributions to the development of students’ integrated scientific process skills. However, in the 


Control Group 


Treatment Group 




Figure 2a. Graph question: Change of Pressure according to Volume, x-axis (pressure, atm): 0.5, 1, 1.5, 2, 2.5, 3, 


argumentation activities based on causal hypothesis, students defending their claims with reasoning, supporting their 
claims with strong evidence-building patterns between concepts, listening to different claims and defences critically, 
and rebutting opposite views made greater contributions to the treatment group students’ skills of determining 
variables, interpreting data scientifically, and using a reason-result relation more than those of the control group. 
This result is in harmony with the literature finding that a scientific argumentation-based teaching approach results 
in better learning by students, thereby improving their scientific thinking (Driver et al., 2000; Erduran et al., 2006; 
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Koray, Koksal, Ozdemir, & Presley, 2007; Osborne et al., 2004a; Ozdemir, 2005; Simon et al., 2006; von 
Aufschnaiter et al., 2004). 


Control Group 


Treatment Group 



Figure 2b. Graph question: Distribution of Students’ Answers according to Options, x-axis: A — 15, B — 12, C — 

4, D - 4, and E - 5. 

Ensuring the acquisition of scientific process skills requires an active process (Carr, 1999; Fusco & Barton, 2001; 
Keys 1994; Seferoglu & Akbiyik, 2006; Yerrick, 2000). Creating a discussion environment in the classroom allows 
students to ask questions, revise their knowledge in the light of evidence, judge the explanations of their peers, 
interpret and analyse data, and consider alternative explanations. 
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In laboratory activities, equipment and tools were not given directly to students. They were only given a problem 
situation and asked to hypothesize about the solution or were given a hypothesis and asked to design an experiment 
to verify it, record obtained data, and assess and interpret findings. In activities in which this approach was used, 
students took a more active part in assessing their existing scientific models, observations, interpreting data, and 


Control Group 


Treatment Group 




Figure 2c. Graph question: Change of Density according to Temperature, y-axis (temperature, °C): 0, 1, 2, 3, 4, 
5, 6, 7, 8, and 9. x-axis (density, gram/cm 3 ): 0,87, 0,93, 0,96, 0,98, 1, 0,99, 0,97, 0,95, 0,92, 0,87. 
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forming new scientific models. 

Scientific process skills can be improved in time with the help of student activities. It should be noted that the 
experiment-designing process skill takes more time and energy to improve. In this study, in order to complete the 
program, there was not enough time for students to participate in experimental activities in practical applications. 
Hence, some experimental activities (i.e., selective precipitation, buffer solutions) that could be performed in a 
laboratory to determine the effects of this teaching approach on experiment design were conducted theoretically via 
discussion-centered experimental activity papers. For the selective precipitation activity, students were given a 
problem situation and asked to suggest a method for the solution. They were given a list (table) that contained only 
the solubility equilibrium constant of salts. In this activity, students studied individually first. The output of this 
activity was really high when students used rebuttals and back-ups. It could be seen that this activity contributed 
greatly to the improvement of students’ developing alternative solutions to the given problem, assessing other 
opinions, and acquiring scientific process and problem-solving skills. 

It can be said that the teaching approach based on scientific argumentation through written and oral 
argumentation activities had an effect on the improvement of these skills. Schafersman (1991) stated that writing 
activity improves organizing thoughts and thinking critically. Hence, in order to improve scientific process skills, 
open-ended questions should be asked in examinations inside and outside the class (Colvill & Pattie, 2003; Harlen, 
1999). Scientific argumentation activity improves students’ use of their existing knowledge and interactions with the 
concepts learned and skill of inquiry (Lazarou, 2009). In such activities, students defended their claims, evaluated 
others’ ideas, and presented different evidence. Actually, they supported a different shared view with different 
evidence, which helped them handle the situation critically, use their knowledge patterns in their defence, get 
meaningful learning, and consequently use the relations between variables. Also, according to 

IMPLICATIONS 

In science classrooms, engaging students in argumentation is not a goal of the curriculum; therefore, teachers 
rarely encourage students to discuss. In their study of 12 elementary school teachers’ use of argumentation in their 
classrooms, Simon et al. (2006) pointed out that before applying the argumentation method the teachers felt 
doubtful about explaining alternative concepts to students since students might strengthen concepts not in 
agreement with scientific truth or confuse themselves and that they felt relieved after teaching with an 
argumentation method. In fact, this means that teachers do not know about argumentation, which is not surprising 
because very few teachers have been educated about argumentation. There are an increasing number of studies 
putting the benefits of argumentation forth in science education; this is the reason why argumentation classes should 
be conducted at postsecondary institutions for future teachers. However, the number of studies that will help 
teachers and educators is very few. By increasing the number of these studies, contributions can be made to the 
educational literature. Studies on the acquisition and improvement of scientific skills have implied that school types 
affect study results. In this study, highly successful students took part. Control group students actively participated 
in classes in which chemical equilibrium and acids and bases units were studied, rather than acting as passive 
recipients. In the traditional approach classes, some students asked high-level questions about problems they 
encountered in and out of the classroom and other students gave answers or shared their observations. Similar 
studies can be carried out in different schools with different levels in order to obtain more objective results. 

In the treatment group activities, some students were eager and inquisitive; however, because experimenting 
carried out in parallel with argumentation required more time than other argumentation activities, experimenting 
and the results were given as homework for students and the next lesson was conducted with their answers. These 
argumentations were not in the expected form. K 1 I 19 et al. ( 2010 ) conducted a study over one term about the effect 
of research, to which pre- and postlaboratory argumentations were added, on the development of scientific process 
skills. In this study, as the laboratory duration was not adequate, no meaningful difference was found statistically 
between treatment and control group students’ scientific process skills. The researchers supported their findings 
with Tan and Temiz’s (2003) study. In order to examine the effect of the argumentation-based teaching approach on 
the acquisition and development of experiment designing subskill and in order to obtain more objective results, a 
longer term study should be conducted. Foundation for scientific thinking ways should be built for students through 
long-term studies on basic scientific process skills in the first level of elementary education (Bozdogan, Ta^demir, & 
Demirba^, 2006). 
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Appendix 1: The Implementation of “Buffer Solution” Activity by the Toulmin Model 
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Appendix 2: Examples of Group Argumantation in Treatment Group 

Activity 1: Selective Precipitation 

Students hypothesized and solved problems using their skills of designing experiments, 

determining and changing variables throughout the activity. 

Group 3 HK: We add AgN 03 which decomposes into its ions in water andprecipitates these anions. 

Chromate and bromine willprecipitate with silver. But we should be slow with that. Be cause first 
we add sufficient AgN0 3 to precipitate one of them. Since the K sp of silver bromine is little, first 
AgBr precipitates. Then we separate the precipitatedpart via filtration. 

Group 4 F§: We specified two ways. We leave the solution for cooling down or heat it up. Since we don’t know 
about that, we decided to cool it down first. Then things run its course and we move on 
accordingly. The one with less solubility willprecipitate. How do the solubility of these change 
with temperature? I think we need to know that. 

We can use this procedure If we want to separate these ions. ..Or we can try this. ..If I have 
solubility equilibrium values, we add a type of salt which precipitates one but doesn’t precipitate 
the other. Tor example, we add salt containing calcium. CaS 04 dissolves little. CaBr 2 doesn’t 
have a K sp . Sulphate ion willprecipitate along with calcium. The table doesn’t consist of all K p 
values, does it? Does Calcium bromine have K p ? Whichever has the less solubility precipitates 
firstly. We separate the precipitated one via filtration. 

Group 1 ES: We thought that we can separate them separately. I mean we first add a type of salt which won’t 
precipitate Bromide ion but precipitate Chromate ion, some salt which can ionise well. We send 
Ca (NO 3 ) 2 - We precipitate Chromate with Calcium. Then we send a type of salt which will 
precipitate Bromine... maybe a type of salt with fine will do that. We thought that since ZnBn 
has K p and will dissolve little in water, it willprecipitate. 

Group 5 BT: But does Chromate precipitate directly with Calcium ? I mean does Chromate precipitate with 
Calcium? I don’t have an anti-thesis but if there isn’t adequate Chromate to precipitate 
Calcium in the environment, there won’t be a separation process, will there? 

Group 1 ES: Why doesn’t it precipitate? Calcium chromate has K sp , it dissolves little, it will surely 

precipitate. Moreover, in HK’s method, only silver was used. There may not be Chromate in 
solution to precipitate silver, right? The thing here is that, if there is K p value, then precipitation 
will occur there. 

Activity 2: Reaction Mechanism 

Students interpreted graphs, determined and changed variables through hypothesizing, 

interpreting and using knowledge patterns throughout the activity. 

Group 3 ME: The reaction takes place in two stages, the first stage is fast and the second one 
is slow as far as we are concerned. Because in the graph the decrease of the 
concentration of X and the formaton of the concentration of J in unit of time was 
faster in the first stage. 

Group 1 ES: J is a reaction intermediate. In our opinion the first stage is fast and the second 
one is slow. Because the consumption of J was faster than its formation. 

Group 4 §A: We don’t agree with these four students. The reaction took place in two stages. 

In the first stage X was consumed faster and J was formed. In the second stage J 
turned into O and this stage occurred more slowly... 

Researcher: Well, can J be a catalyst? 

Group 2 ES: No. Because it was formed firstly in the reaction and then it was consumed. Ok, 
it was entirely consumed, it wouldn’t take place in the reaction but. .We don’t 
think so. It is a reaction intermediate. Because it was formed before... 
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Appendix 3: Criteria Scales and Scoring Rubrics 


Category _ Explanation _ Score 

Analytical Criteria Scale of The Experiment Design Evaluation 

Independent variable • Mentioning how the independent variable could be changed 1 

• Not mentioning 0 

Controlled variable • Four or more controlled variables 3 

• Two or three controlled variables 2 

• One controlled variables 1 

• No controlled variable 0 

Dependent variable • Mentioning how the dependent variable could be measured 1 

• Not mentioning 0 

Testing hypothesis • If the mentioned experiment design was adequate to the test hypothesis 2 

• If not adequate 1 

• If it could not test the hypothesis 0 

Data Analysis Evaluation Criteria Statement 

Title of table • If table tide included variables 2 

• If tide included one variable 1 

• There was no title table 0 

Structure of table • If dependent variable was recorded on the first line or column 2 

• If not 1 

• If it was recorded out of the table as another format (e.g., picture, graph, 0 

etc.) 

Names of variables • If there was a line or column tide for dependent and independent 1 

variables (for each) 

• If not 0 

Units • If the units were written correctly 2 

• If a unit was not written 1 

• If all units were not written 0 

Saving the data • If all data were recorded correctly 3 

• If 1-2 data groups were incorrect 2 

• If there were more than three mistakes 1 

• If all data were recorded incorrectly 0 

Ordering • If data were listed in descending or ascending order 1 

• If there were no order or sequencing 0 

• If there were no unnecessary line or columns 1 

• If there were empty cells 0 

• If the lines drawn clearly and neatly 1 

• If not 0 
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Graphs Control Evaluation List 

Title • If a title including all variables on the graph were written 1 

• If not 0 

• If names of variables were written next to x-axis and y-axis 1 

• If not 0 

Axes • If axes were numbered in an ascending order in equal intervals starting 1 

from point “0” 

• If not 0 

• If numbers were shown and drawn neatly 1 

• If not 0 

Graphs • If appropriate graph format was chosen for data 1 

• If not 0 

• If all data pairs were placed on axes correctly 1 

• If not 0 

Neatness and order • If graph strips were drawn understandably 1 

• If not 0 

Analytical Criteria Scale of Determining Variables and Hypothesizing 

Controlled variable • Writing 5 or more variables that affect dependent variable 3 

• 3 or 4 variables 2 

• 1 or 2 variables 1 

• No variable 0 

Hypothesis • Writing hypothesis in an appropriate format 2 

• The tense of the verb of hypothesis was not written correctly 1 

• The hypothesis was written irrelevandy 0 

Dependent / • Variables were written correctly (for each) 1 

independent variable # Not mentioned 0 

_ • Coding the dependent variable incorrectly _0 
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